Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test: System Fuzzer Updates #1605

Merged
merged 7 commits into from
Oct 3, 2023
Merged

Conversation

talekhinezh
Copy link
Member

Summary

Speed up System Fuzzer. Add Sys system calls to System Fuzzer.

@talekhinezh talekhinezh marked this pull request as ready for review September 30, 2023 01:33
@talekhinezh talekhinezh changed the title Test/speed update system fuzz Test: System Fuzzer Updates Sep 30, 2023
@github-actions
Copy link

github-actions bot commented Sep 30, 2023

Benchmark for e33a27b

Click to view benchmark
Test Base PR %
costing::bench_prepare_wasm 80.2±0.45ms 80.3±0.59ms +0.12%
costing::decode_sbor 16.4±0.11µs 16.4±0.05µs 0.00%
costing::decode_sbor_bytes 52.0±0.43µs 51.7±0.31µs -0.58%
costing::deserialize_wasm 1448.5±3.30µs 1472.1±5.08µs +1.63%
costing::instantiate_flash_loan 4.2±0.57ms 4.5±0.68ms +7.14%
costing::instantiate_radiswap 5.7±0.04ms 5.7±0.06ms 0.00%
costing::spin_loop 24.1±0.12ms 24.3±0.06ms +0.83%
costing::validate_sbor_payload 29.8±0.09µs 29.5±0.04µs -1.01%
costing::validate_sbor_payload_bytes 371.2±0.60ns 396.2±1.01ns +6.73%
costing::validate_secp256k1 87.4±0.24µs 87.4±0.06µs 0.00%
costing::validate_wasm 45.2±0.11ms 44.9±0.09ms -0.66%
decimal::add/0 9.3±0.00ns 9.3±0.00ns 0.00%
decimal::add/rust-native 11.0±0.02ns 10.9±0.01ns -0.91%
decimal::add/wasmer 130.4±0.29ns 136.5±0.28ns +4.68%
decimal::add/wasmer-call-native 548.7±0.39ns 554.6±0.81ns +1.08%
decimal::add/wasmi 903.5±4.01ns 893.9±4.15ns -1.06%
decimal::add/wasmi-call-native 8.7±0.01µs 8.3±0.02µs -4.60%
decimal::div/0 176.4±0.54ns 173.7±0.29ns -1.53%
decimal::from_string/0 175.0±0.71ns 174.6±0.23ns -0.23%
decimal::mul/0 125.1±0.09ns 126.4±0.12ns +1.04%
decimal::mul/rust-native 121.2±0.07ns 123.4±0.26ns +1.82%
decimal::mul/wasmer 1659.5±1.14ns 1654.8±0.91ns -0.28%
decimal::mul/wasmer-call-native 691.4±0.74ns 686.1±0.45ns -0.77%
decimal::mul/wasmi 69.7±0.05µs 68.1±0.06µs -2.30%
decimal::mul/wasmi-call-native 8.8±0.01µs 8.5±0.07µs -3.41%
decimal::pow/0 585.9±0.64ns 587.3±1.23ns +0.24%
decimal::pow/rust-native 574.5±0.53ns 574.1±0.59ns -0.07%
decimal::pow/wasmer 7.2±0.01µs 7.8±0.02µs +8.33%
decimal::pow/wasmer-call-native 1099.6±1.14ns 1095.0±0.67ns -0.42%
decimal::pow/wasmi 326.3±0.11µs 323.7±0.18µs -0.80%
decimal::pow/wasmi-call-native 9.4±0.03µs 9.3±0.03µs -1.06%
decimal::root/0 8.8±0.01µs 9.2±0.01µs +4.55%
decimal::sub/0 9.4±0.01ns 9.4±0.01ns 0.00%
decimal::to_string/0 535.6±0.46ns 531.9±0.37ns -0.69%
precise_decimal::add/0 10.7±0.68ns 10.4±0.31ns -2.80%
precise_decimal::add/rust-native 12.4±0.00ns 12.4±0.00ns 0.00%
precise_decimal::add/wasmer 134.2±0.11ns 139.0±2.69ns +3.58%
precise_decimal::add/wasmer-call-native 575.8±0.25ns 582.5±0.42ns +1.16%
precise_decimal::add/wasmi 1190.1±13.46ns 1127.5±5.52ns -5.26%
precise_decimal::add/wasmi-call-native 9.2±0.02µs 8.8±0.01µs -4.35%
precise_decimal::div/0 346.6±1.16ns 353.0±7.25ns +1.85%
precise_decimal::from_string/0 233.3±0.31ns 233.6±0.35ns +0.13%
precise_decimal::mul/0 367.5±0.49ns 368.5±1.38ns +0.27%
precise_decimal::mul/rust-native 336.6±0.20ns 349.7±0.24ns +3.89%
precise_decimal::mul/wasmer 3.8±0.00µs 3.8±0.00µs 0.00%
precise_decimal::mul/wasmer-call-native 922.7±1.45ns 955.8±3.04ns +3.59%
precise_decimal::mul/wasmi 177.8±0.09µs 175.3±0.06µs -1.41%
precise_decimal::mul/wasmi-call-native 9.7±0.01µs 9.4±0.01µs -3.09%
precise_decimal::pow/0 1978.0±2.19ns 1998.2±3.10ns +1.02%
precise_decimal::pow/rust-native 1557.1±2.96ns 1585.2±3.58ns +1.80%
precise_decimal::pow/wasmer 17.8±0.03µs 17.9±0.01µs +0.56%
precise_decimal::pow/wasmer-call-native 2.3±0.00µs 2.3±0.00µs 0.00%
precise_decimal::pow/wasmi 856.9±0.68µs 845.0±0.36µs -1.39%
precise_decimal::pow/wasmi-call-native 17.3±0.04µs 17.2±0.18µs -0.58%
precise_decimal::root/0 62.8±0.05µs 64.0±0.04µs +1.91%
precise_decimal::sub/0 10.6±0.03ns 10.4±0.01ns -1.89%
precise_decimal::to_string/0 793.7±1.58ns 793.6±0.50ns -0.01%
schema::validate_payload 324.6±0.44µs 326.9±1.12µs +0.71%
transaction::radiswap 8.1±0.16ms 8.1±0.04ms 0.00%
transaction::transfer 3.0±0.01ms 3.0±0.01ms 0.00%
transaction_processing::prepare 3.1±0.01ms 3.1±0.01ms 0.00%
transaction_processing::prepare_and_decompile 7.0±0.02ms 7.0±0.03ms 0.00%
transaction_processing::prepare_and_decompile_and_recompile 26.8±0.15ms 27.1±0.13ms +1.12%
transaction_validation::validate_manifest 48.8±0.15µs 48.7±0.05µs -0.20%
transaction_validation::verify_ecdsa 84.9±0.26µs 85.0±0.07µs +0.12%
transaction_validation::verify_ed25519 60.7±0.19µs 60.2±0.11µs -0.82%

@talekhinezh talekhinezh force-pushed the test/speed-update-system-fuzz branch from 1b91b58 to ce39b7b Compare September 30, 2023 02:13
@talekhinezh talekhinezh force-pushed the test/speed-update-system-fuzz branch from ce39b7b to c7aeda0 Compare October 2, 2023 15:58
@lrubasze
Copy link
Contributor

lrubasze commented Oct 2, 2023

LGTM. But please fix the CI issue before merging.

Copy link
Contributor

@mstrug-rdx mstrug-rdx left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks ok.

@talekhinezh talekhinezh merged commit 2df2495 into develop Oct 3, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

3 participants